BASES FOR DIAGONALLY ALTERNATING HARMONIC 
POLYNOMIALS OF LOW DEGREE 
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Abstract. Given a list of n cells L — [(pi, gi), . . . , (p„, q„)] where Pi,qi G Z>o, 
we let Al = det \\{pj\)~^ {qj\)~^ x^^ ||. The space of diagonally alternating poly- 
nomials is spanned by {A^} where L varies among all lists with n cells. For 
a > 0, the operators Ea — J27=i Vi^xt ^^t on diagonally alternating polynomials. 
Haiman has shown that the space A„ of diagonally alternating harmonic polyno- 
mials is spanned by {ExAn} where A — (Ai, . . . , Af) varies among all partitions, 
Ex = Ex,---Ex,_ and A„ = det || ((n - j)!)"'^;,""' || • For t = e Zl^g 

with > • • • > ti > 0, we consider here the operator Ft = det ||£'t^_^.^j+(j_i) || . 
Our first result is to show that FjA^ is a linear combination of A^/ where L' is 
obtained by moving £{t) — m distinct cells of L in some determined fashion. This 
allows us to control the leading term of some elements of the form Ft^^^ ■ ■ ■ i^^^^j A„. 
We use this to describe explicit bases of some of the bihomogeneous components 
of An = A^'' where A^-' = Span{£:AA„ : ^(A) = I, |A| = k}. More precisely, we 
give an explicit basis of A^'^ whenever k < n. To this end, we introduce a new 
variation of Schensted insertion on a special class of tableaux. This produces a 
bijection between partitions and this new class of tableaux. The combinatorics of 
these tableaux T allow us to know exactly the leading term of Ft An where Ft is 
the operator corresponding to the columns of T, whenever n is greater than the 
weight of T. 



1. Introduction 

The theory of Macdonald symmetric polynomials [Ij is a very active and deep 
area of mathematics. At the heart of this theory lies the study of {q, t)-Catalan 
numbers and the space of diagonal harmonics introduced by Garsia, Haiman and 
collaborators (see |3jJ and references therein). The space over Q of diagonal harmonics 
in 2n variables is given by 

n 

H^ = {Pe Q[X„, Y„] : J2 = 0,h + k>0}, 

i=l 

where X„ = {xi, X2, ■ ■ ■ ,Xn} and Yn = {yi, ?/2, . . . , ?/„}. One of the many fascinating 
properties of this space is that its dimension [2] is (n -|- l)"-"^. 

The symmetric group <S„ acts diagonally on Q[X„, Yn]. That is, for P G Q[X„, Yn], 
the action a G iS„ is defined by aP = P(xo-(i), . . . , Xo-(n), l/o-(i), • • • ,ya{n))- Since the 
defining equations of Hn are all symmetric, it is clear that Hn is an i5n-module. We 
can then consider the subspace of Hn consisting of alternating polynomials. That is 

An = {PeHn:aP= (-l)^('^)p, Va G 5„}, 
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where i{a) denotes the length of cr. The space of polynomials Q[X„,1^] is bigraded 
in Z>Q using the total degree in the variables X„ and the total degree in the variables 
Yn- Since the diagonal action of iS„ on Q[X„, F„] preserves both degrees in Xn and 
Yn, we have that Hn is a bigraded iSn-module and An = 0^ i A^^ is an iSn-submodule 
of Hn- Here A^^ consists of the bihomogeneous polynomials in An of total degree 
—k in the variables X„ and total degree I in the variables Yn- We have shifted 
the degree in X„ to simplify the formulation of our theorems. The polynomial 

^^n(g,t) = g^$^dim(A^'')g-¥, 

k,l 

is known as the (g, t)-Catalan polynomial [ZIE]- In particular, the dimension of An 
is the Catalan number C„ = — 7-r f^"). 

" n+l \ n J 

Given a list of n cells, L = [{pi, gi), . . . , {pn, g„)] where pj, G Z>o, we let 



det 



The space of all diagonally alternating polynomials in Q[X„, y„] has a basis given by 
{Al}, where L = L{D) varies among all sets D C Z>q of cardinality n and L(D) is 
the elements of D given in a sorted list. For a > 0, the operators 

n 
i=l 

act on diagonally alternating polynomials. Haiman [2] has shown that the space An 
is spanned by {ExAn}, where A = (Ai,...,A^) varies among all partitions. Ex = 
■ ■ ■ Ex, and A„ = A[(o,o),{i,o),...,(n-i,o)]- We have that 

A^J = Span{ExAn:ii\) = l,\M=k}, 

where £(A) = / denotes the number of parts of A and |A| = Ai + ■ ■ ■ + A;. 

For t = {tm,---,ti) G Z™Q with > ■ ■ ■ > ti > , we consider the operator 
Ft = det ||-E't„_^^i+(j-i)||. Our first result (Theorem 4.6) is to show that FjA^ is a 



linear combination of A/^/, where L' is obtained by moving i{t) = m distinct cells of L 
in some determined fashion. Given a column-strict Young tableau T we can associate 
to each column of T an F-operator as above and define F^ to be the operator obtained 
as the product of the F-operators corresponding to the columns of T. For k < n, 



we show (Corollary 8.3) that a basis of A^'^ is given by {Ft An}, where T runs over 
certain column-strict Young tableaux. 

To this end, we introduce a new variation of Schensted insertion on a special 
class of tableaux (Section [6] and Section [?]). This produces a bijection A ^ T{\) 
between partitions and this new class of tableaux (Section |8]). The combinatorics of 
the tableaux T(A) allow us to know exactly the leading term of FT(x)^n whenever 
n is larger than the weight of T. We believe that the insertion algorithm presented 



here may be of interest on its own: Corollary 8.3 is just one application of our 
construction. We point out that it is possible to get Corollary 8^ more directly but 
this is less revealing for us. 
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We present two short sections to recall some facts about (g, t)-Catalan numbers 
(Section [2]) and an ordering of the diagonally alternating polynomials (Section [s]). 

2. (g, t)-CATALAN 

In this section we recall some of the basic definitions related to (g, i(:)-Catalan 
numbers. 

Definition 2.1. A Dyck path of length n is a lattice path from the point (0,0) to 
the point (n, n) consisting of n north steps (0, 1) and n east steps (1,0), that never 
cross the line y = x. The i^^ row of a Dyck path lies between the line y = i — 1 and 
y = i. 

We denote by DPn, the set of all the Dyck paths of length n. Dyck paths of 
length n are in bijection with sequences g = {go, . . . , gn-i) of n nonnegative integers 
satisfying the two conditions 

(2 1) I 9o = , 

The i*^ entry gi_i of the sequence g corresponds to the number of complete lattice 
squares between the north step of the i^^ row of the Dyck path and the diagonal 
y = X. Such sequences are called Dyck sequences. 

Definition 2.2. Given a Dyck path c G DPn, let [go, ... , gn-i) be its corresponding 
Dyck sequence. The area and coarea of the Dyck path are given by 

n— 1 n — 1 / 

«(c) = ^9i and ca(c) = - 9i = ^ a(c) 

i=0 i=0 

respectively. The bounce statistic of the Dyck path is defined recursively as follows: 

Kc) = b{9o, • • • , 9n-i) = n-l- gn-i + h{gQ, 5(„_2-g„_ J, 
where for the empty sequence e = (), we let 6(e) = 0. 

Example 2.3. The Dyck sequence g = (0,0,1,2,0,1,1,2,3,0) corresponds to the 
following Dyck path c 



The area and coarea of this Dyck path are a(c) = 1 + 2 + 1 + 1 + 2 + 3 = 10 and 
ca(c) = 45 — 10 = 35. The bounce statistic of c is given by 

6(c) = 9 + 6(0, 0, 1, 2, 0, 1, 1, 2, 3) = 9 + 5 + 6(0, 0, 1, 2, 0) = 9 + 5 + 4 + 6(0, 0, 1, 2) 
= 9 + 5 + 4 + 1 + 6(0) = 9 + 5 + 4 + 1 + = 19. 
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Remark 2.4. A partition /i of m G Z>o, denoted by /i h m, is a sequence /i = 
(yUi,/i2, • • • ,/^«) of positive integers in non-increasing order: ^ii > li-z > ■ ■ ■ > l^i and 
:= X]!=i A^i = The coarea of a Dyck path corresponds to the size of the 
partition A* = = (/xi, . . . ,/in-i) defined hj fii = n — i — Qn-i- Here A* denotes 
the transpose of the partition A. In the Example 2.3, /i = (9, 5, 5, 5, 4, 4, 1, 1, 1) and 
A = yU* = (9,6,6,6,4,1,1,1,1) are partitions of size 35. The transpose here is the 
reflection of ^ across the anti-diagonal. 

Let 

(2.2) C„(g, t) = q^C^{q-\ t) = J2 dim(A^'')g¥ . 

k,l 

A result by Garsia and Haglund [H [3] gives that 

Cn{q,t)= J2 

c£DP„ 

In particular, 

(2.3) C,,{q,t)= J2 q'^^'h'^"^ . 

c£DP„ 

3. Sorting and ordering of diagonally alternating polynomials 

In this section, we give a basis of diagonally alternating polynomials. Using an 
order on this basis we define a notion of leading term for any diagonally alternating 
polynomial. 

Given a set of n distinct cells D = {{pi,qi), ■■■ , {Pn,Qn)} C we say that the 
cells are sorted if for all i < j we have that qi < qj or (g^ = qj and Pi < pj). We let 
L{D) = [{pi,qi), . . . , {Pn,qn)] G (Z^)" denote the sorted list. On the other hand, if 
we are given a list of n cells L = [{pi, gi), . . . , (p„, g„)] G (Z^)" and if all pi, qi > 0, 
we let 

1 



det 



Otherwise we let A^, = 0. Notice that if the cells of L are not distinct, then we 
also get Al = 0. We call a list of n cells L = [{pi, qi), . . . , (p„, g„)] E (Z^)" a lattice 
diagram . 

For a kttice diagram L = [{pi, gi), . . . , (p„, g„)], let L = L{{{pi, gi), . . . , {pn, Qn)})- 
That is L is the list L sorted. In particular we have 

where the sign is determined by the sign of the permutation that reorders L into L. 
A basis of diagonally alternating polynomials in Q[X„, Yn] is given by the set 

(3.1) {ALiD)-DcZl, and \D\ = n} . 

Two sorted lattice diagrams L{D) = [{pi,qi), ■ ■ ■ ,{Pn,(ln)] and L{D') = 
[{p[, q[), . . . , (p^, g^)] can be compared using the following lexicographic order: 

{Ps,qs) = {p's,q's), i + l<s<n, 
{Pi,qi) < {p'i,q'i) . 



(3.2) L{D) -< L{D') ^ 
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Given a diagonally alternating polynomial 1^) = aiA^Oi) + (12^l(D2) + ■ ■ ■ + 

ar^LiDr) with all Oj 7^ 0, we define the leading diagram of f{Xn; Yn) to be A^r,^) 7^ 0, 
where L{Dk) >- L{Di) for all i ^ k and 1 < i < r. 



4. F-Operators 



In this section we introduce the operator F for a column and show its basic prop- 
erties. A composition a of n, denoted by a \= n, is an ordered sequence of pos- 
itive integers a = (ai, 02, . . . , a^) such that \a\ := — ^- For a |= n we let 
Ea = Ea^Ea2 ' ' ' Ea^. Let Sk deuote the symmetric group on k elements and let 



a : Sk 
w 

where ai{w) = i — w{i). 



a{w) = {ai{w),a2{w), ak{w)) , 



Remark 4.1. For any w & Sk, we have that Yl^=i 



Eli(^-MO)=0. This 



implies that for any t = {tk,t 



ti) e Z>o and w e Sk 



k 
i=l 



tk- 



i+1 



k 

i=l 



(tk-i+i + ai{w)) = \t + a{w)\. 



If t = {tk, tk-i, ■ ■ ■ ,ti) G Z^Q satisfies tk > t^-i > ■ • ■ > ^i, then 

tk-i+i > tk-i + I > ■ ■ ■ > ti + {k - i) 
for all 1 < i < fc. Since ai{w) = i — w{i) > i — k, we have that 

tk-i+i + Ciiiw) > ti + {k — i) + i — k > ti > 
for all 1 < 2 < A;. This shows that t + a{w) is a composition of |t|. 
Definition 4.2. Given t = {tk, tk-i, ■ ■ ■ ,ti) G Z^q with tk > tfc_i > 
- = det(E,,_^,^,+(,_.)) = J2 i-iy^'"^E,+aM- 

weSk 



> ti> 0, let 



Here l{w) = Card{{i,j)\i < j,w{i) > w{j)}. From Remark 4.1 the operator F is 
well defined and takes a homogeneous polynomial of bidegree (r, s) to a homogeneous 
polynomial of bidegree {r — ti — ■ ■ ■ — tk, s + k). 



Lemma 4.3. Given t = {tk, tk-i, . . . ,ti) G with tk > tfc-i > 
i we have ti = + 1, then Ft = 0. 



> ti, if for some 



Proof. If ti = ti_i + 1 for some 1 < i < k, then the {k — i + l)*'^ and {k — i + 2)*^^ 
columns in the determinant of F are the same. □ 

Therefore, we shall assume that ti > tj_i + 2 in the definition of F-operators. The 
following lemma is useful for our purpose. 
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Lemma 4.4. Let L = [(pi, gi), (p2, Q2), ■ ■ ■ , {Pn, Qn)] be a lattice diagram. We have 



(L), 



i=l 



where 



(4.1) 



E]{.L) = . . . , (pi - + 1), . . . , (p„,g„)]. 



Proof. Recall that the determinant = c-Alt(x^^?/^^ ■ ■ ■ x'^y'^) where c is a constant 
and Alt denotes the alternating sum over the symmetric group. For any symmetric 
operator \E', we have that Alt o \1> = \1> o Alt. The lemma follows using = Ej. □ 

We can also generalize this result to the case where there are several i^j's acting 
consecutively on A^. 

Lemma 4.5. Let L = [{pi, qi), {p2, ^2), • • • , {Pn, qn)] and a = {ak, Ofc-i, ... ,ai) a com- 
position. We have: 



Ea^L = Eaj^Eaj^_-^ ■ ■ ■ -^ai A^ 



(L) 



/:{l,...,fc}^{l,...,n} 



where Ef{L) = E^i'^^Elt, • ■ ■ E[^^\l) as m Eq k.l\ 



Combining the definition of the operator F with Lemma 4.5 gives 



/:{!,. ..,fc}-+{l,...,n} 



As the following theorem shows, many terms in this sum cancel. 

Theorem 4.6. For t = {tk, tfc-i, ■ ■ ■ ,ti) E Z'^q where ti > + 2 for all 2 < i < k, 

and L = [{pi, qi), {p2, ^2), • • • , (Pn, qn)], we have 



(4.2) 



A, 



/:{!,. ..,fc} — > {1 , . . . ,n} injective 



t-\-a{w)^ ' 



For f injective, we can explicitly describe £'/_^^(^)(L) = [{p[, q[), {p'^, ^2), • • • , (K, Qn)] 



(Ps - ti- ak-i+i{w),qs + 1), ifs = f{i), 
{ps,qs), otherwise. 
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Proof. The left-hand side of equahty (|4.2|) can be written into sums as follows: 

Fn 



tk 



A, 



/:{!,. ..,fe}-^{l, 



t + a(tu)(-^) 



/:{!,. ..,fe}^{l,...,n} 

non—injective; 



t-\-a{w) 



/:{1 >{l,...,n} injective 



By definition, t + = {tk + 1 — + 2 — w{2), . . . ,ti + k — w{k)) and thus 



E 



(L). If / is non-injective, we can 
always find a pair such that f{i) = f{j) where k > i > j > 1. The operator 

eI,,s{L) related to such an / is 



{^■O) ^tk+l-w{l) ■ ■ ■ ^ti + {k-i+l)-w{k~i+l) ■ ■ ■ ^tj+{k-j+l)~w{k-j+l) ■ ' ' ^ti+k-w{k)\-^ > ■ 

Let w = w{k — z + l,A; — j + 1), and notice that a{w) = (1 — . . . , A; — z + 1 — 
w{k — j + 1), . . . , /c — j + l — w{k — i + l), . . . ,k — w{k)). We then have that E/_j_^^^^(L) 



is equal to 



(4.4) E/^') 



pf(i) 

ti + (k-i+l)-w(k-j+l) ■ ■ ■ tj + (k~j+l)~w{k~i+l) " ' ' ti+k-w{k) 



From Equations (4.3) and (4.4), we can see that the only difference between Ej.j^^^^-^{L) 
and Ej_^^f^^^{L) are the ii^-operators related to i and j. Since f{i) = f{j), we have 

pfii) pfU) 
ti+{k-i+l)-w{k-i+l) tj+{k-j+l}-w{k-j+l) 



-- E 



.E' 



fU) 



(L). 



ti+(k-i+l)-w{k-j+l) tj+(k-j+l)-w{k-i+l) 

Indeed, this only changes the cell {pf{i),qf{i)) in L into 
(P/W - U -t,~{k-i + l)-{k-j + l) + w{k~i + l)+ w{k -3 + 1), qf({) + 2). 

Since the i?-operators commute, we conclude that E^_^_^^_^-^{L) = E^^^^^^^^L). 

For any / non-injective, we pick the lexicographically unique pair {if,jf) such that 
f{if) = fUf) and if > jf > 1. We have 



/:{!,. ..,fc}^{l,...,n} 

non-^njective; 



t-\-a.{w) 



/:{!,. ..,fc}^{l,...,n} 

non-^njective; 
w £ Sj^ ; even 

0. 



A, 



t + a(w(k-ij: + l,k-jjy+l)) 



{L)j 



This implies the theorem. 



□ 
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Remark 4.7. For L = L{D) a sorted lattice diagram, let f°: {1, 
be defined by f°{i) = i. We have 



,k} {l,...,n} 



f injective, m^Sf^ 



t + a(w) ^ 



=A^/0|.^^ + {lower terms). 

In particular, if A^/Oj.^^ 7^ 0, then it is the leading diagram of FiAl. To see this, we 
show the following claim. For any {f,w) 7^ (/°,id), we have that 



(4.5) 



in the order defined in Eq (3.2). Also if Li -< L2, then for any / we have 
(4.6) EliL,) -< EiiL^). 

First consider the case where w 7^ id. Let s be the largest integer such that asiw) 7^ 0. 
We must have that asiw) = s — w(s) > since ag+iiw) = ■ ■ ■ = auiw) = 0. We have 
tk-i+i + ai{w) = tk-i+i for all s + 1 < 2 < k, and tks+i + a^(w) > tks+i- This gives 

In the case where w = id, we have a (id) = (0, . . . , 0). In particular, for f f^, 

E{° , JL)y E{^ , AL). 



The Eq (4.5) follows by transitivity. Eq (4.6) is clear. 



Example 4.8. Let t = (3,1) and L = [(0, 0), (1, 0), (2, 0), (3, 0), (4, 0)]. Applying 

we get 



A, 



M(0,0),(l,0),(2,0),(0,l),(3,l)] 



3A 



[(0,0),(1,0),(2,0),(1,1),(2,1)] 



- 3A[(o,o),(l,0),(4,0),(0,l),(l,l)] + ^[(0,0), (2,0), (3,0), (0,1), (1,1)] 
+ 2A[(o,o),(l,0),(3,0),(0,l),(2,l)] 

Clearly A[(o 0) (1 0) (2 0) (o 1) (3 1)] is the leading diagram and it is obtained by 
E|Ei([(0,0),'(l,0),'(2,0)',(3,0),(4,0)]). 



5. F- Operators on the space of alternating diagonal harmonics 

In this section we define the operator Ft associated with a column-strict Young 
tableau T. We also construct an explicit basis of A^'' for / < 2. This allows us to 
better understand for which T the elements -Fr^n are linearly independent. 

Given a partition /i = (/ii,/i2,. • -.[ii], let = {{i,j) e Z^q : I < j < /ij,Vl < 
i < I}. A tableau T is a function T: — )■ Z>o- Here the partition fi is called the 
shape of T. By convention, set T{i,j) = 00 if (i,j) ^ Z}^. The transpose of fi is the 
partition /i* where D^t is the transpose of D^. A column-strict tableau is a tableau 
T such that for all (i, j) G D^, we have T{i,j) < T{i + 1, j) and T{i,j) < T{i,j + 1). 
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We usually let tij{T) = T{i,j) or just tij if it is unambiguous. We graphically put 
tij in a box at position in D^. For example, 



T 



4 


5 




2 


3 


3 


4 


1 


1 


2 


2 



is column-strict and ^2,3 = 3. Given a column-strict tableau T we denote its shape by 
fi(T) = (/ii(T), /i2(T), . . . , /iz(r)) and row sum by s(T) = (si(T), S2(T), . . . , s;(T)), 

where Sj(T) = tj^iH \-ti,^l^■ We may simply use = (/ii, ...,/!;) and s = (si, . . . , s;) 

if the tableau is clear. We see that {si, S2, ■ ■ ■ , si) forms a composition of |s| = 
■Si + S2 + ■ ■ ■ + s/, which is the sum of all numbers in the tableau T. Let Tj denote 
the j*^ column in the tableau T for all 1 < j < fii. We define the F-operator 
corresponding to T by: 



(5.1) 



Ft Ft 



-'mi -'mi- 



■ ■ ■ Ft^Ft^. 



Since T is column-strict, Ft is well defined. Now we use it to generate sets of 
polynomials which are linearly independent. 

Theorem 5.1. For 1 < k < n - 1, let Tk = {[k]} . The set 

Br, = {^gA„} 

is a basis of the space A'^^ and dimA^"^ = 1. For all other values of k, dimA^'^ = 0. 

Proof. Notice that the leading term of F^An is A[(o,o),(i,o),...,(n-i-fc,i)] 7^ for 1 < 
k < n — 1. It is clear that the set Bj-^ = {FgA„} 7^ {0} is linearly independent. 

Combining Eq ( 2.3 ) and Eq ( 2.2 ) , we see that dim A^'^ is given by the number of Dyck 
paths with bounce equal to 1 and coarea equal to k. We then claim that dimA^'^ = 1 
for 1 < k < n — 1 and zero otherwise. This is because the only way to get 6(c) = 1 
is if the Dyck sequence of c is of the form 

{0,1,2, . . . ,n — k — l,n — k 

for 1 < A; < -n, — 1. 



1, . . . ,n — 3,n — 2) 



When j > i + 2, we have F 



Fr- 



« \ J 



EiEj. 



E. 



3,^ 



E. 



For j 



I 01 I 



□ 

1, we have 



Theorem 5.2. For 2 < k < 2n — 2, the set of polynomials {Ft An} where 



T 



i+l 



i<n-2. 



i < n 



i + 2 <j <n-2 
1 < i < n-A, 



and \s{T)\ = k forms a basis of A^' . For all other values of k, dimy4„' = 0. 
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Proof. We first show linear independence. When 2i < n — 1, the leading diagram of 
EiEiAn is 

A[(0,0),(l,0),...,{n-2,0),(n-l-2i,2)] ^ 0. 

When 2i + 1 < n — 1, the leading diagram of EiEi+iAn is 

A[(0,0),(l,0),...,(n-2,0),(n-2i-2,2)] 7^ 0. 

When 2i > n and i < n — 2, the leading diagram of EiEiAn is 

^[(0,0),(l,0),...,(n-3,0),(n-2-j,l),(n-l-i,l)] 7^ 

and when 2i > n and i < n — 3, the leading diagram of EiEi^iAn is 



J 
is 



^[(0,0),(l,0),...,(n-3,0),(n-3-i,l),(n-l-i,l)] 7^ 0. 

< n — 2 and 1 < i < n — 4, using Remark 4.7, the leading 



Now when i + 2 < 
diagram of FrriA, 

^ A[(o,0),{l,0),...,(n-3,0),(n-2-i,l),(n-l-j,l)] 7^ 0. 

In each of the above cases, ExAn has a different leading diagram for different T, 
which implies that {Ft An} is linearly independent. 

The only way to get b{c) = 2 in Eq (2.3) is if the Dyck sequence of c is of the form 
i9o,9u ■ ■ • ,5'n-i) where gn- 



n 



3 and = 0. As in Remark 2.4 we consider the 



partition X = fi . The restriction on the Dyck sequence gives us that A has exactly two 
non-zero parts and the largest part is less than n — 2. That is A = (j, i), j <n — 2 
and i+j = k. In particular, the coarea of such a path has to be 2 < /c < 2n — 2. The 
case j = i or i + 1 corresponds to the tableaux T of shape (2) and when j > i + 2 it 
corresponds to the tableaux T of shape (1, 1). The dimension of A^'^ has exactly the 
desired cardinality. For all other values of k, dimA^'^ = 0. □ 

6. Definition and some properties of framed tableaux 

In order to generalize the results o f the pre viou s section, we need to study a special 
kind of Young tableau. In Theorem 5.1 and 5.2, a basis of A^''' for Z < 2 is obtained 



from a set of the form {ExAn} where T are well chosen. It suggests that for T with 
small shape, the rows must weakly increase with small differences and columns should 
have jump greater than or equal to 2. In the light of this observation, we introduce 
a new kind of tableau which allow us to generalize the result for larger /. 

Definition 6.1. Given fi = (/xi, /i2, . . . , fii) and s = (si, S2, . . . , si), we say that (/x, s) 
satisfies the framing condition if 

1. Si > {2i — and 

2. Sj+i > Si + 2fii for all 1 < -j < / — 1 such that yUj+i = /ij. 



Our goal is to build a new kind of tableau with shape /i and row sum s. The 
following definition is useful for our algorithms. 

Definition 6.2. Given an integer c G Z>o, there is a unique way to decompose it into 

m positive integers Ci < C2 < ■ ■ ■ < such that c = Ci H h and < Cj — Cj < 1 

for all 1 < 2 < j < m. We say that B-comp(c, m) = (ci,ci, . . . ,Cm) is the balance 
composition of c. 
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Given (yU, s) satisfying the framing condition in Definition 6.1, we give a procedure 
that constructs a unique column-strict tableau of shape /i and row sum s. We call 
the procedure framing and the resulting tableau a framed tableau. By convention let 
f^i+i = 0. 

Fram(/i = (/ii, fi2, . . . , fii), s = (si, S2, • • • , si)) 
(ti^i, ti^2, ti,^,i) := B-comp(sz, /ii) 
For i = I — 1 Downto 1 Do 
k := I; a := Si] b := /ij 
While A; > i Do 

('^i./.fe+i+i, • • • , ri,^,,) = B-comp(a, b) 
If Tij < tj+ij - 2, V/ife+i + 1 < J < /ifc 
Then t^j := r^j, V/ifc+i + 1 < J < /ifc 
Else := ti+ij - 2, V/ifc+i + 1 < j < /ifc 

a := a - H htj,^J; b := b - {jj,k - jJ-k+i); k := k - 1; 

Output T = [tjj]. 

We write T = Fram(/i, s). 

Remark 6.3. The framing procedure is well defined and gives a unique framed 
tableau Fram(yU, s) for each [fi, s) satisfying the framing condition. The top row is 
clearly unique. Suppose we perform the procedure properly and uniquely up to row 
i + 1. For row i, if fii > fii+i, then the procedure works well. If /ij = /Xj+i, then the 
framing condition gives that Si + 2/ij < Sj+i, which guarantees that the procedure 
produces a unique tableau. 

Proposition 6.4. The framing procedure is an injection from the {fi, s) which sat- 
isfies the framing condition for column-strict tableaux. We call framed tableaux the 
subset of tableaux in the image o/Fram. 



Example 6.5. For a given s = (22, 18,24, 14) and /i = (8,5,4,2), we construct the 
corresponding framed tableau Fram(/i, s) with the above procedure: 































7 


7 
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7 
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5 


7 


7 














-> 


7 


7 








5 


5 


7 


7 






3 


3 


4 


4 


4 








7 


7 


5 


5 


7 


7 


3 


3 


4 


4 


4 


1 


1 


2 


2 


2 


4 


5 


5 



We have the following properties for framed tableaux. 



Lemma 6.6. A framed tableau T of shape jj,, is a column-strict Young tableau of 
shape fi satisfying the following properties: 

1. Any two numbers in the same column differ by at least 2. 

2. For any a < b in the same row ofT we have b — a< 1, unless there is a number 
d above a such that d = a + 2. 
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To illustrate this, consider the following picture: 



a ■ ■ ■ b 



Normally, a and b need to satisfy the condition b — a < 1. However ii d = a + 2, then 
there is no restriction on 6 — a. To prove Lemma 6.6, we need the following auxiliary 
result. 

Lemma 6.7. Suppose that we have two sequences of integers ci < C2 < ■ ■ ■ < c„ and 



di < d2 < ■ ■ ■ < dn+m satisfying Cj 



< 1, for all 1 < i < j < n and dj — di < 1, 



for alll<i<j<n + m. If there is a k such that Ck 
all 1 < j < n. 



dk < 1; then cj — dj < 2, for 



Proof. For 1 < j < A;, we have Cj = Ck or Ck 



Cj - dj < Ck - {dk 
dk + I- Hence c,- - 



1 and, dj 



- 1) < 2. For k < j < n,we have Cj 
dj < Ck + I - dk < 2. 



dk or dk — 1- Hence 
Ck or Cfc + 1 and, dj = dk or 

□ 



Proof of Lemma |6.6 It is clear that the row / of T(^s,fj.) given by B-comp(s;, /i^) = 
i'ti,i,ti,2, ■ ■ ■ ,ti,fj.i) satisfies Properties 1 and 2. By induction, suppose that up to row 
2 + 1, Properties 1 and 2 are satisfied. Moreover, we assume (by induction) that for 
2 + 1 < A;' < /, we have 

3. tk'j^ - tfc'ji < 1, for all fik'+i + 1 < ii < j2 < f^k'- 
Recall here that we let /i^+i = 0. For row i, we consider the while loop of the framing 
procedure. The properties 1,2 and 3, certainly hold whenever tj+ij > Vij + 2, for 
1 < j < fJ'i+i- If at one point, ioi i < k < I, there is fik+i + 1 < jo < /^fe such that 
ti+ijo ~^i,jo ^ 1) then by Lemma 6.7 we have tj+ij- 

t 



The framing procedure sets all j 



compare a 



a - {t 



< 2 for all yUfc+i + 1 < j < yUfc- 
— 2, for /ifc+i + 1 < j < fik- When we 



H \- ii.Mfc) with a' := a - (r^,^ +i 



Hi^k)^ we 



obtain a' < a. Hence B-comp(a',6) < B-comp(a,6) component-wise. This implies 
that the row is weakly increasing. Properties 1, 2 and 3 also hold in this case. □ 

Example 6.8. The following are framed tableaux of shape (3, 2, 1): 



6 






3 


4 




1 


2 


2 



6 






4 


4 




1 


1 


2 



5 






5 






3 


6 




3 


7 




1 


1 


2 




1 


4 


5 



The following is not a framed tableau: 



4 


5 




1 


2 


6 



since the difference between 1 and 



6 is greater than 1, but the number above 1 is 4, which is not exactly 2 more than 1. 

From the definition and properties of framed tableaux the following lemmas can 
be obtained immediately: 

Lemma 6.9. Suppose T is a framed tableau. If we add or subtract some constant 
k from each number in T and if all entries remain positive, then we get a framed 
tableau and we denote this by T ± k. 
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Lemma 6.10. Suppose T is a framed tableau. If we delete the bottom row in T, then 
the remaining tableau is still a framed tableau. 

Lemma 6.11. For a framed tableau T , suppose the i*^ and j^^ columns {i < j) 
have the same height. We list the entries of each column, from bottom to top, as 
{ai, 02, ... , fln} one? {bi, 62, ... , &n} respectively. Then — < 1, for all 1 < k < n. 

Proof. Since the i^^ column and the j*'* column [i < j) have the same height in the 
framed tableau T, by the framing procedure we know that there exists a k such that 
/ifc+i + 1 < < j < /^fc. We have bn — an < 1 since both entries are parts of a 
balance composition. By induction, assume bg — ag < 1 for 1 < k < s < n. For 
k, either the entries and bk are parts of a balance composition, or they satisfy 
ttk = flfc+i ~ 2 and bk = b^+i — 2. By the induction hypothesis we have in the latter 
case bk- ak = bk+i - o-fc+i < 1. □ 

Remark 6.12. The contrapositive of this lemma gives the following: suppose columns 
i and j are ai, . . . , a„ and bi, . . . ,bm respectively, and there exists some k such that 
bk ~ o-k^ 2, then n > m. That is column i is strictly higher than column j. We use 
this to detect the structure of framed tableaux. 



7. Insertion and Taquin 

The goal of this section is to describe the procedures that give a bijection between 
partitions A h n and framed tableaux with row sum s = (si, . . . , s;) |= n. For this 
purpose we need a procedure similar to Schensted's algorithm, with some additional 
straightening steps to get a framed tableau. 

Given a framed tableau T = [tij] of shape /i and < x < ti^i, we define a procedure 
to insert x into T and denote the resulting framed tableau by T x. The algorithm 
is done in three steps. First we do an insertion that gives an auxiliary tableau Y. The 
tableau Y determines a shape /x' = ^(Y). We use Y in the second step to determine a 



row sum s' such that (/i', s') satisfies the framing condition of Definition 6.1 Finally, 
T ^ X is given by Fram(/i', s'). In our pseudocode, a loop of the form "For ... To ... 
While A Do ..." is a standard For loop that stops as soon as A is false. 

Recall that for a framed tableau T = [tij] of shape = /x(T) = (/xi, . . . , fii) we 
assume that /i^+i = and tij = 00 for j > fii. 

T ^ X 

Step 1: auxiliary insertion, getting Y and fi' 
i := 1; Xo := x 
While ti^^^ > X + 2 do 
J := Min{j : t,j > x + 2} 

X • i 2 1/ • 1/ I X 

(ti^i, . . . , := Sort()f:j,i, . . . , ti^^^,x) 

F:=[t,,,]; ^':=/i(F); /':= length (/x') 
Step 2: finding the new row sum s' 
X := xo; (si, . . . , si>) := s(Y) 
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For z = 2 To /' Do di := 
For A; = 1 To /' - 1 While tk,^>^ > x + 2 Do 
For j = l To fi',^. Do 

If tkj = X Then tfc+ij := x + 2 

If tk,n'^ > X + 2 and tk,j = x + 1 Then tk+i,j := x + 3 

dk+i '■= Sk+i — Sfc+i 
X := X + 2 

s' := (si + d2, S2 + d^ - d2, . . . , Si'_i + dv - dv^i, Sv - d^) 
Step 3: 

Output Fram(/i', s') 

We show in Section [8] that the T ^ x algorithm is well defined for < x < ti^i 
and produces a framed tableau. We give a short example to better demonstrate the 
steps. 



Example 7.1. Let x = 1 for 



T 



In Step 1, we get Y 



4 


5 




1 


2 


6 


6 



Notice that the resultant tableau Y from step 1 may not be a framed tableau. We need 
to straighten Y to get a framed tableau. We get fj,' = (4, 2) and s(Y) = (15, 9). The 
second loop in Step 2 sets d2 = l + l = 2 and in the end s' = (15 + 2,9 — 2) = (17, 7). 
The pair (/i', s') satisfies the framing condition so we can apply the framing procedure 
and get 

T ^ 1 = Fram(17, 7) 



3 


4 




1 


2 


7 


7 



Most entries in T ^ x might be different from those in T. But we remark that 
all the entries with value equal to x or x + 1 in the tableau Y in Step 1 still remain 
unchanged in T <(— x, and x is the smallest entry in T ^ x. This fact is important 
and allows us to introduce an inverse procedure. This is done by playing a variation 
of Jeu de Taquin. Again this is done in three steps. We start with a framed tableau 
T = [tij] of shape /x = /i(T) = (/xi, . . . , fii) and assume that x = ti i. We denote by 
xT the framed tableau we obtain by removing x from T with the following procedure: 
T 

Step 1: Jeu de Taquin to get Y and fi' 
I := 1; J := 1 
X := ti l 

While ti+ij < oo or t^j+i < oo Do 

If tj+ij > tij+i + 2 Then t^j := tjj+i; j := j + 1 

If ^ + 1 

Then tij := tj+ij; (ti,i, . . . , ti,/,J := Sort(ti,i, . . . , i := i + 1 

F:=[t,,,]; fi':=fi{Yy, /':= length (/x') 
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Step 2: row sum s' 
{si,...,si>) := s{Y) 
For i = 2 To /' Do d, := 

For A; = 1 To /' - 1 While tky^ > x + 2 and tk,i < x + 1 Do 
For j = l To fi',^. Do " 
If tkj = X Then tk+ij := x + 2 

If tk,ij,'^ > X + 2 and tkj — x + 1 Then tk+ij :— x + 3 

Sk+l '■— tk+l,l + tk+l,2 H 1- tk+l,fj,'i^^^ 

dk+l '■— Sk+l — Sk+l 

x := x + 2 

s' := (si + d2, S2 + d3-d2,..., Si>^i + d^ - di>^i, si> - di') 
Step 3: 

Output Fram(/i', s') 

Again, we show in the next section that this algorithm works and is well defined. 
We give here a short example to better show the steps. 



Example 7.2. Given a framed tableau T = ^ ^ , we remove x = 1 from T in the 
first step of xT. We use a dot to indicate the position of the cell as we perform the 
jeu de taquin. 



6 






6 






6 






6 




4 


5 


-)> 


4 


5 




4 


• 


— > 


4 




• 


1 


1 


• 


1 


5 


1 


5 



= Y . 

Again, Y may not be a framed tableau. We have ii' = n{Y) = (2, 1, 1) and s{Y) = 
(6,4,6). The second loop in Step 2 sets d2 — 1 and ^3 = 0. In the end s' — 
(6 + 1, 4 + — 1, 6 — 0) = (7, 3, 6). The pair (/i', s') satisfies the framing condition so 
we can apply the framing procedure and get 

= Pram(/x', s') 



6 




3 




1 


6 



8. 1-1 Correspondence between partitions and framed tableaux 

In this section we construct a 1 — 1 correspondence between partitions and framed 
tableaux. Given a partition (Ai, . . . , Xk) \~ I, we get a framed tableau as follows: 

(8.1) ^ A := (• • • ((0 ^ Ai) ^ A2) • • • ^ Xk). 

On the other hand, given a framed tableau T, we get a partition A(T) by recording 
the numbers removed each time with 



(8.2) 



(•••..(.,T)---) = 0. 



Then A(T) := (x^, . . . ,X2,Xi) h |s(T)|. This is not the shape of T that we denoted 
by Ijl{T). We prove here that these two maps are inverse to each other, and thus 
there is a bijection between partitions and framed tableaux. First, we give a lemma 
to reduce the number of cases we have to consider. 
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Lemma 8.1. Given T = [tij] and < a; + 1 < ti^i, we have 

T ^ {x + 1) = {{T - x) ^ 1) + X, 

x+iT = ( i(T - x)) + X. 

Proof. The result of T 4— (x + 1) is determined by the differences between x and the 
ti/s. It is clear that fi(T <— {x + 1)) = /i((T — x) ^ l). Furthermore, the cij's in 
the procedure T (x + 1) and (T — x) 4—1 are the same for all 2 < i < /. Thus we 
have that s(T ^ (x + 1)) = s(((T — x) ^ l) + x). In both cases, we produce the 
same framed tableau. The argument for the second equality is similar. □ 

Theorem 8.2. Let T = [Uj] and < x < 

(a) The procedures T x and are well defined and inverse to each other. 



(b) The maps defined by (8.1) and (8.2) give a bijection X -H- T between X\- k with I 
parts and the framed tableaux T such that ^{T) h / and s{T) \= k. 

Proof. Part (b) follows directly from Part (a). We show (a) case by case. From 



Lemma 8.1| it is sufficient to consider only the cases of inserting and removing 1 from 
any given framed tableau. Let T: — t- Z>o be a framed tableau with shape /i and 
row sum s = (si, S2, ■ ■ ■ , Si): 



T 



^2,1 
^1,1 



^2,2 
^1,2 



Case 1. Assume that ti^i > 3 and let m = In Step 1 of T ^ 1, we obtain 



tm,l 

Y = tm-lA tm,2 



1 



^2,2 
^1,2 



Let [y^J] 
and fi' = 



= Y. We have that s{Y) = (si-ti,i + l, 52-^2,1+^1,1, 

= (/ii, . . . , /i/, 1). In Step 2 of T ^ 1, as A; varies from row 1 to m, we 



have X = 2A; — 1. Since ti^i > 3 we have yk,fMk ^ ^fe.i ^ '^1,1 + 2fc — 2>2A; + l = x + 2. 
The entries in the first column are sequentially changed to yk+1,1 := 2A; + 1 since the 
entry in row k is yk,i = 2k — 1 = x. No other entries are changed since for j > 2 we 
have yk j > tki > 2fc + 1 > x + 1. The loop stops after k = m since for row m + 1, 



we have x = 2m + 1 and at that moment, y. 



"i+i,M^ 



2m + 1 



then have that d2 = ti,i — 3, . . ., dm+i = ^m,i — (2m + 1), dm+2 



X ^ X + 2. We 
■ = di = 0. Thus 



(si -2,S2 -2, 



- 2,2m + lA 



m+l,l5 



/,1; 



Since 



the new row sum is s' 
{fi, s) satisfies the framing condition of Definition 6.1 it is easy to check that (/i', s') 



also satisfies the framing condition. We can thus compute Fram(/i', s') in Step 3 of 
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T i— 1. Since /i^+i = 1 and s'^ 



m+l 



each row l<A;<m + lof Fram(yu', s') is 2k - 

hi 



2m + 1, we must have that the first entry of 
1. We obtain 



T' = T ^ 1 = Fram(^', s) 



2m+l 
2m- 1 

3 
1 



m,2 



''2,2 
^1.2 



For 1 < A; < m, we have t'^, 2 + 



2k + 1 = Sk - 2k - 1 > Sk - t 



fc,i 



tk,2 + ■ ■ ■ + ^A:,Atfe- This imphes t'f^j > t^j for all 1 < k < m and j > 2. Now we want 
to show iT' = T. In Step 1 of iT', we get 



Y 



''2,2 
''1,2 



We now get that ji' = fi{Y) = and s(Y) = Let [yij] = Y. Since 

2/1,1 = 3^2 = x + l, wedo not do any loops in Step 2. Clearly (/i, s) satisfies the 
framing condition and iT' = Fram(/i, s) = T. 

Case 2. Row A; = 1 of T contains only I's or 2's or both. Let 



T 



and 



r 



1 2 



1 1 



1 2 



In Step 1 of T ^ 1, we obtain Y = T'. Nothing happens in Step 2 since for k = 1 
we have <2^3 = x + 2. Hence s' = s{Y) = s(T') and fi' = fi{Y) = fi{T'). 
In the procedure Fram(/i', s') it is clear that the entries in the row k > 1 will be 
the same as in T. For /c = 1, the balanced composition (1, 1, . . . , 1, 2, . . . , 2) will not 
change as all entries will be at least two less the the entry directly above. Hence 
T 1 = Fram(/i', s') = T' . For the inverse procedure, y = T in Step 1 of iT'. 
Again nothing happens in Step 2 since ti^^j < 2 ^ 3. Hence iT' = Fram(/i, s) = T. 

Case 3. Row A; = 1 of T only contains I's and numbers greater than or equal to 3. 



From Remark 6.12, since ai > 3, the shape of T must be as follows 



18 



N. BERGERON AND Z. CHEN 



T 



2fc+l 
2fc-l 

2m-l 

3 
1 



2k+l 
2k-l 

2m- 1 

3 
1 



a2 &2 

ai 6i 



B 



C 



We use A, 5, C to denote the corresponding portion of T . Notice that C has the 
same structure as in Case 1. When we insert 1 in Step 1 of T ^ 1, the tableau Y 
is obtained by inserting 1 in C and the first column of C is shifted up. In Step 2, 
as in Case 1, the loop runs for /c = 1 to m. All the entries in the portion B of the 
tableau are set back to their current values, hence left unchanged. Only the entries 
in C are affected. In conclusion, this case reduces to Case 1. The same argument 
applies for the reverse procedure where the loop in Step 2 may run but no entries 
will be changed. 



Case 4. Row k = \ oiT contains 2's, and possibly some I's, together with numbers 



greater than or equal to 4. Again from Remark |6.12[ since a\ > 4, the shape of T 
must be as follows: 



T 



2r+l 
2r-l 

2m- 1 

3 

1 



2r+l 2r+2 

2r-l 2r 

2m— 1 2m 

3 4 

1 2 



2r+2 
2r 

2m 

4 

2 



(^m bfyi 

a2 &2 
ai bi 
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Y 



2r+l 
2r-l 

2m+l 
2m-l 

3 

1 



2r+l 2r+2 

2r-l 2r 

2m+l 2m+2 

2m— 1 2m 



2r+2 
2r 

2m+2 
2m 



3 
1 



4 
1 



4 
2 



2 



&2 



We have that 

s{Y)={s,{Y),S2{Y),...,si{Y)) 

= (Si — ai + 1, S2 — Cl2 + 0-1, . . . , Sf. — flj. + CXr-l; -^r+l + ^^r; -5^+2 

and /i' = ii{Y) = (/ii, . . . , fir, fir+i + 1, yUr+25 • • • , Let [^jj] = F and let c be the 
index of the column with the Oj's. That is yi^c = 2 and i/i^c = o-i-i for 2 < 2 < r + 1. 
Also let c' < c be the index of the column where 1 is inserted. That is yi^c' = 1 and 
Ui^c' = 2i for 2 < i < r + 1. In Step 2 of T ^ 1, as varies from 1 to m, we have 
X = 2k — 1 and since 61 > 4 we have yk,^^ > bk > bi + 2k — 2 > 2k + 2 > x + 2. 
The entries in column c are sequentially changed to yk+i,c '■= 2k + 2 since the entry 
in row k is yk,c = 2k = x + 1. Also the entries in column c' are sequentially changed 
to yk+i,c' '■= 2k + 1 since the entry in row k is y^^c' = 2k — 1 = x. The other entries 
in columns 1 < J < c' — 1 and c' + l < j <c— 1 are set back to their current 
values, hence left unchanged. No other entries are changed since for j > c + 1 we 
have ykj > bj^ > 2k + 2 > x + 1. The loop stops after k = m since for row m + 1, 
we have x = 2m + 1 and at that moment, ym+i,f_i'^^-^ = 2m + 2 = x + l^a; + 2. We 
then have that ^2 = Oi — 3, . . . , dm+i = am — (2m + 1), dm+2 = ■ ■ ■ = di = 0. Thus 
the new row sum is 

2, . . . , ~ 2, Sjn+l + 2m + 1 — Ctm+l, Sm+2 + (^m+l ~ Q'm+2i ■ ■ ■ 



(8.3) 



1^1 



J S rp I Ci^ 



We claim that (yu', s') satisfies the framing condition of Definition 6.1 In the insertion 
algorithm every yij should satisfy yij > 2i — 1, and the value change in step 2 still 
guarantees Si{Y) — di > {2i — These imply s[ > {2i — for all 1 < i < /. For 

1 < i < m — 1 and fi'^^^i = fi[, we have s[^i — s'^ = (sj+i — 2) — (sj — 2) = Sj+i — Sj > 
2/ij = 2/i'j. For m + 1 < i < r, since Sj+i — aj+i — (sj — Oj) > 2(/ij — 1) = 2(/i'j — 1), we 



get s'i 



+ ai — ttj+i — [Si + Oj 



> 2(/x^ - 1) + 2 = 2/i^. Remember that 



(/i, s) satisfies the framing condition. Thus together with the case when z > r + 2, 
s'j = Si, /i'j = fii, we obtain that {fi!,s') also satisfies the framing condition. We can 
now compute Fram(/i', s') in Step 3 of T ^ 1. Notice that row m + 1 of F after 
Step 2 contains only 2m + I's and 2m + 2's and it is already balanced. Moreover the 
entries in the row just above will be at least two more. This implies that row m + 1 
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of Pram(//', s') contains only 2m + I's and 2m + 2's, which determines uniquely the 
numbers below and preserves all the I's and 2's in T ■<— 1. We get 



(8.4) 



T' = T ^ 1 = 



r+1,1 

2m+l 
2m- 1 

3 
1 



2m+l 2m+l 
2m-l 2m-l 



3 
1 



3 
1 



2m+2 
2m 

4 

2 



2m+2 
2m 



b'2 
bL 



where 6^ > 6^ > 2i + 2, for 1 < i < m. Also i'^+2j- > 2m + 4 for c' < j < c and 
a'^+i > 2m + 4. 

Now, we want to show iT' = T. In Step 1 of iT', the dotted box = (1, 1) 

travels right on the first line to (1, c'), then up the column to (m + 1, c'), then right 
along row m + 1 to (m + 1, c) and up that column to the end. We get 



(8.5) 



Y 



r + 1,1 

2m+l 
2m- 1 

3 
1 



2m+l 2m+2 
2m— 1 2m 



3 
1 



4 
2 



2m+2 a; 



2m 
4 

2 



m+l 
2m+l 

5 
3 



b'2 

bL 



We get that /i' = IJ^{Y) = /j,. Let [yij] = Y and we have that yi^i < 2. In Step 2, for 
k — 1 to m, we have x = 2k — 1 and the conditions Uky^ >b'^>bk>2k + 2>x + 2 
and yjfc^i <2k <x-\-l hold. The loop sets Uk+ij in column 1 < j < c — 1 to the same 
values, so no change occurs here. That is d2 = ■ ■ ■ = dm+i = 0. Now for A; = m + 1 
to r we have that conditions J/fc,^^ = a'^ > d'm+i + 2(A; — m — l)>2A; + 2>a; + 2 
and Uk^i = 2k — l<x + l hold. The loop sets yk+i,j = 2A; + 1 for 1 < j < c' — 1 
and = 2/i; + 2 for c' < j < c — 1. The loop stops after k — r since yr+i./x^+i = 

2r + 2 = x + l ^x + 2. We have (ir+2 = • • • = (i/ = and for m + 1 < /c < r we have 

4+1 = 4+1,1 + ■ ■ ■ + tUi,c-i - (c' - l)(2fc + 1) - (c - c')(2fc + 2) 
— ttk — a'^ . 
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The second equality follows from comparing the fc + l*'^ entry of s(T') in Eq M) with 



the row sum of s(T') in the framed tableau in Eq (8.4). We also remind the reader that 



from the start, row k+1 of T is such that Sfc+i — a^+i = {c' — l){2k+l) + {c—c'){2k+2). 



The row sum s{Y) for Y in Eq (8.5) is obtained from s(T') in Eq (8.3). We have 

= (Si, . . . , Sm, Sm+l + (^m+l ~ '^m+l; -5771+2 + '^771+1 ~ C^7Tt+2 ~ '^m+1 ^ '^m+2' • • 



The expression for s' at the end of Step 2 in the procedure \T' then gives us s' = s = 
s(T) and then iT' = Fram(/i, s) = T. 

Case 5. Row k = \ oiT contains 2's and 3's, possibly some I's and possibly some 
numbers greater than or equal to 4. Depending on the numbers appearing in the first 
row of T, we have 



T 



3 4 
1 2 



4 

2 3 



3 c 



or 



3 ■ ■ ■ 3 c ■ ■ ■ c' ■ ■ ■ 
1---12---23---3 



where c, c' > 4. If there is no c in the first row, then from Lemma 6.6, we are not 



forced to have 4 above the 2's in the first row and there is thus no restrictions on 
the numbers above those 2's. We use induction on the length / of T to prove this 
case. For /(T) = 1, it is easy to check that all the procedures are well defined and 
i(T <^ 1) = T. Assume that the result is true up to /(T) = n, and T 1 preserves 
the added 1 and all the I's and 2's in T. That is the I's and 2's of Y in Step 1 of 
T 1 are left unchanged in the remaining steps. This was the situation in Cases 1-4 
above. For Z(T) = n + 1, let denote the first row of T and T2 denote the remaining 



tableau. That is T2 consists of rows 2 and up of T. From Lemma |6.10| we know that 
T2 is a framed tableau of length n. In Step 1 of T 1, to get Y , we insert 1 in R. 
We then have that 3 is bumped up and inserted in T^- Denote by Yi the result of 
Step 1 of T2 ^ 3. Clearly Y^ is also the tableau we get from rows 2 and up of Y . We 
have 



T 




and 



Y 




It is important to remark that the number of I's in the first row of Y is exactly 
the number of 3's in the first row of Y2. In Step 2 of T 1, for = 1 we have 
2/i,Ati > 3 > a; + 2. In the case when there are numbers c > 4 in the first row of T, we 
must have 4 above each 2 in the first row. The first loop of Step 2 just sets all values 3 
and 4 back to the same values. Hence ^2 = in this case. If there are only I's, 2's and 
3's in the first row of T, then there is no restriction above the 2's. But in this case, 
we have = 3 ^ x + 2 and no number above the 2's changes. Hence in all cases 
= 0. The remaining loops of Step 2 of T ^ 1 are identical to Step 2 for T2 ^ 3. 



By the induction hypothesis and Lemma 8A_, T2 ^ 3 is well defined and gives a 
framed tableau = T2 3 such that all the 3's and 4's in the first line are the same 
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as Y2. The shape /i' = yu(i^) = (/ii,/i2, . . . , fi'i,) where (yUg, . . . , fi'i,) = /i(l2) = /^(^2)- 
Also s' = (si — 2, s'2, . . . , S;/) where (s2, . . . , s^,) = ^(Tg). It is clear, by definition, that 
(/i(T2), s(T2)) satisfies the framing condition. In fact, since the smallest entry of T2 is 
3, we also have that T2 — 2 is a framed tableau. This implies that s'^ > {2i — for 



2 < i < v. Clearly, si — 2 > /xi, so we only need to verify Condition 2 of Definition |6.1 
for i = 1. If /ii > yUg) then there is nothing to check. By Cases 1-4 and by induction, 
we remark that s[ > si — 2. This implies that for Tg, we have > S2 — 2. Hence 
if /ii = /i2 = /^25 then > S2 — 2 > si + 2/ii — 2 = (si — 2) + 2yUi. We are left to 
consider the case where /ii = /ig = /i2 + 1. This may only happen if all the entries in 
the second row of T are only 3's and 4's and in this case 



T ^ 1 



3 4 ■■■ 4| 
1 2 ■■■ 2 3l 



^ 1 



3 3 
1 1 



4U 
22] 



By induction, the entries in the second row are 3's and 4's. Clearly S2 > (si — 2) + 2yUi. 
We have that in all cases s') satisfy the framing condition and we get a well defined 
framed tableau T' = Fram(yu', s') = T 1. All the I's and 2's in the first row of Y 
are preserved in T'. 

Now we consider the procedure iT'. Let be the framed tableau formed by rows 
2 and up of T'. In Step 1, we get a tableau Y with a 1 replaced by a 3 in the first row 
of T', and a tableau Y2 in rows 2 and up of Y. Again it is clear that Y2 is the same as 
the one obtained in Step 1 of 3T2. In Step 2, for k = 1, we have yi^i < 2 = x + 1 and 



and Lemma 8.1 



X + 2. The same argument as above shows that d2 = 0. The remaining 
p 2 of iT' are the same as Step 2 in 3T2. By the induction hypothesis 
we know that 3J 



T2 is well defined and gives rows 2 and up of T. 
The first row sum of Y is now Si, so at the end of Step 2 we have s' = s{T). Also 
for fi' = fJ,{Y), we clearly have fi[ = fii and by the induction hypothesis fi[ = fii for 
i >2. Hence we get T = Fram(/i, s) =1 T' . This proves Case 5. 

Let J^k,i = {T framed tableau : /i(T) h /, s(T) |= k} and let Vk,i = {A = 
(Ai, . . . , A;) h k}. So far, we have that T = x(T x) for all T G J^k,i and x. This 
implies that the map (T, x) 1— )■ (T x) is injective. We have an injection Vk,i ^ J^k,i 
defined by A h-)- (0 ^ A). Let us pick n > k and consider {FtA„ : T e Tk,i] C. A^K 
For T G Fk,h let (/^i? • • • ? A^r) = /^(T"), (si,...,Sr) = s{T) and F-p defined as in 



Eq (5.1). Iterating Remark 4.7, we get 



Ft An -Ft^^Ft^^_^ 
=Ft^^Ft^^_^ 

=Ft^^Ft^^^^ 



■ Ft^Ft-^Au 

■Ft, (A 1°,,,, , ^+ lower terms) 

4i[(0,0),(l,0),...,(n-l,0)] ' 



Ej,^^; i[(o,o),(l,0),...,{n-l,0)] 



+ lower terms) 



(8.6) 
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where f°: — )■ {1,...,?t,}, 1 < j < /ii are defined by fj{i) = i for all 
1 < 2 < /i*. So we have 

E^J;o. . -o^f [(0, 0), (1, 0), . . . , (n-l, 0)] = [(0, 0), . . . , (n-r-s„/i,), . . . , (n-l-s^, ft,)] 
Since n> k, thus we have A[(o,o),...,(n-r-s,,/i,),...,(n-i-si,Ati)] ^ 0, which gives the leading 



diagram of Ft An- Proposition |6.4| gives us that for different framed tableaux T 
we get different pairs {fi,s), hence different leading terms for Ft An- This gives us 
that the set {Ft An : T G J^k,i} C A'^'^ is linearly independent. Recall that the 
dimension of A^'' is the coefficient of g'^t' in Cn{q,t)- We claim that this coefficient 
is equal to \Vk,i\- Indeed for k < n, we have that any partition A G Vk,i satisfy 
\i = k — X2 — \i<k — l + l<n — l + l- For k < n, if we consider /x = A* G Vk,i 



as in Remark 2.4, then we have a bijection between A G Vk,i and the Catalan paths 



with coarea equal to k and a single bounce /. This gives 



\VkA < iJ'kA <dimA^'' = \Vk 



and we must have equality everywhere. This shows that the map (T, x) H- (T ^ x) 
must be surjective. Hence is well defined everywhere and inverse to T ^ x. □ 



The computation in Eq (8.6) shows the following: 



Corollary 8.3. Let Cn,k,i be the coefficients of q^t^ in Cn{q,t). We have: 

1. If k < n, then Cn,k,i is the number of partitions of k into I parts; 

2. There exists a natural map A t— )■ -F^j^a between partitions and F-operators such 
that if |A| < n, then the set of polynomials {F^^xAn '- A G Vk.i} forms a basis of the 
space y4^''. 

Remark 8.4. When k > n the leading diagram for F^^x is not necessarily given by 



Remark 4/7 This complicates the investigation of finding a basis for those cases. We 
were successful in finding bases for any k and / = 3, but the analyses is much more 
complicated. 

Remark 8.5. We presented the work here with the perspective of finding a basis for 
A^'K But the combinatorics of the bijection between partitions and framed tableaux 
via T ^ X and could be very interesting in their own right and have different 
applications. 
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